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(57) In recording audio information, an information 
medium in a format obtained by expanding the RTR 
(recordable/reproducible DVD) standard is used. For 
management information about each piece of informa- 
tion recorded on the information medium, an "audio 
infomnation cell" is defined as a playback unit even for 
audio information as in the RTR standard. To a PGC 
(program chain) higher in level than the cell, "playback 
sequence" information about the relationship between 
other video information (movie cells) and/or still picture 
infonnation (stilt picture cells) is given. 
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Description 

Technical Field 

[0001] This invention relates a data structure (or a 
recording fomnat) capable of recording one or more 
types of information, including audio information, 
among video (movie) information, still picture (still 
image) information, and audio (sound) information and 
performing common management of these types of 
information, an information medium for recording infor- 
mation using the data structure, and a method of 
recording information based on the data structure onto 
an information medium. 

Background Art 

(Prior Art) 

[0002] DVD videos (for playback only), optical discs 
on which video information has been recorded by a 
video compression method complying with the MPEG 2 
standard, have already been commercialized and rap- 
idly been popularized. On the other hand, recorda- 
ble/reproducible DVDs which enable the user to digital- 
record analog video information have begun to appear 
on the market. The recordable/reproducible DVD is also 
called RTR (real-time recording recordable/reproducible 
DVD). The standardization of streamers that record dig- 
ital TV broadcast reception video information (digital bit 
streams) is also in progress. In the format structure con- 
forming to the standard that allows the user to record 
video information, playback units are represented in 
cells as in the format of the DVD video disc and the rela- 
tionship between the individual cells is included in PGC 
(program chain) control information. Presently, MDs 
(minidiscs) are available on the market as user-oriented 
digital audio recording mediums. 

(Subjects) 

[0003] Since the RTR (recordable/reproducible 
DVD) disc differs from the MD in the disc size and the 
data format in recording, the MD recording data cannot 
be recorded directly in the RTR (recordable/reproduci- 
ble DVD) format. Moreover, in the RTR (recorda- 
ble/reproducible DVD) standard, audio information 
cannot be recorded on an information medium inde- 
pendently. Thus, presently, there is no method of 
recording audio information tog ether with video informa- 
tion and/or still picture information on a single informa- 
tion medium and reproducing those types of information 
in a mixed manner in an arbitrary order. 

(Objects) 

[0004] An object of the present invention is to pro- 
vide a data structure (format structure) which enables 



not only video information, still picture infonnation 
and/or audio information to be mixed with each other 
and recorded on the same information medium but also 
any area in each of the video information, still picture 
5 information, and audio infonnation to be reproduced in 
an arbitrary order. 

[0005] One other object of the present invention is 
to provide an infonnation medium on which information 
is recorded using the data structure (format structure). 
w [0006] Still one other object of the present invention 
is to provide a method of recording information based 
on the data structure (format structure) on an informa- 
tion medium. 

15 Disclosure of Invention 

[0007] To accomplish the object, a data structure 
(or a format structure) according to the present inven- 
tion is as follows: 

20 

1. Audio information is recorded on an information 
medium in a format obtained by expanding the RTR 
(recordable/reproducible DVD) standard. 

2. For management infonnation about each piece 
25 of infonnation recorded on the information medium, 

an "audio information cell" is defined as a playback 
unit even for audio information as in the RTR stand- 
ard. To a PGC (program chain) higher in level than 
the cell, "playback sequence" information about the 
30 relationship between other video information 
(movie cells) and/or still picture information (still pic- 
ture cells) is given. 

[0008] To accomplish the one other object, an infor- 
35 mation medium according to the present invention has 
an audio information recording area 
(RTR_STO.VRO/RTR_STA.VRO/RTR_AUD.VRO/STR 
EAM.VRO) In which audio information is recorded and a 
management area (RTR.IFO/STREAM.IFO) in which 
40 management information about the recording area is 
recorded. On the information medium, other information 
(including video information and still picture information) 
as well as audio information can be recorded. In the 
management area (RTR.IFO/STREAM.IFO), manage- 
rs ment information about other information (including 
video information and still picture information) as well as 
audio information can be recorded. Moreover, in the 
management area (RTR.IFO/STREAM.IFO), informa- 
tion about the relationship between all the pieces of 
so audio information in reproducing or information (PGCI) 
about the relationship between the audio information 
and information (including video information and still 
picture information) other than the audio information 
can be recorded. 
55 [0009] To achieve the still one other object, a 
recording method according to the present invention 
comprises a first recording process (step STIO) for 
recording one or more type of Information including 
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audio information onto the information nnedium and a 
second recording process (step ST12) for writing addi- 
tionally management information about the recorded 
infomnation onto the information mediunn or changing 
the management information. 

[0010] In the second recording process (ST12). 
information (original PGC/user-defined PGC) about the 
relationship between the audio Information and other 
recording infomnation (video infomnation and/or still pic- 
ture information) in reproducing the audio Information 
recorded on the infomnation medium in the first record- 
ing process (ST10) is written additionally into the man- 
agement area (RTR.IFO/STREAfy/I.IFO) on the 
information medium or is changed and recorded in the 
management area. 

[0011] To execute what have been described 
above, an embodiment of the present invention provides 
the following: 

A. Cell type information is given to a piece of infor- 
mation corresponding to each cell. Pieces of identi- 
fication information called "movie cell," "still picture 
cell,** and "audio cell" are included in the cell type 
information. This makes it possible to discriminate 
between video information, still picture Information, 
and audio information and mix these types of infor- 
mation with one another, 

B. "Composite cell" information is further included 
in the cell type infomnation, which provides a struc- 
ture that makes it possible to reproduce specific 
(arbitrary) audio information, while reproducing 
specific (arbitrary) still picture information. 

C. "Silent cell" infomnation is added in the cell type 
information, which enable the user to set a silent 
period. 

D. The audio infomnation is provided with "time 
map" information as in the case of the video infor- 
mation. Use of the time map information makes it 
possible to make time search for the audio informa- 
tion at any time (at any playback time). 

Brief Description of Drawings 

[0012] 

FIG. 1 is a diagram to help explain a recording for- 
mat (a recording data structure) of audio informa- 
tion recorded on an information medium and a 
recording format (a recording data structure) of 
management information about the audio informa- 
tion; 

FIG. 2 Is a diagram to help explain an example of 
the directory structure of a data file; 
FIG. 3 Is a diagram to help explain an example of 
the recording data structure on a recordable/repro- 
ducible information medium; 
FIG. 4 is a diagram to help explain the configuration 
of a recording and reproducing apparatus accord- 



ing to an embodiment of the present invention; 
FIG. 5 is a diagram to help explain the relationship 
between the data structure of a time search table 
for storing the time search table entries correspond- 
5 ing to the audio entries of FIG. 1 and the addresses 

(playback positions or playback times) of the audio 
objects (AOBs). the contents of the recorded audio 
information; 

FIG. 6 is a flowchart to help explain an example of 
10 the procedure for recording Information according 
to the present invention; 

FIG. 7 is a diagram to help explain another example 

of the directory structure of a data file; 

FIG. 8 is a diagram to help explain still another 

15 example of the recording data structure on a 
recordable/reproducible information medium; 
FIG. 9 is a diagram to help explain still another 
example of the recording data structure on a 
recordable/reproducible information medium; 

20 FIG. 10 is a diagram to help explain still another 

example of the recording data structure on a 
recordable/reproducible information medium; 
FIG. 11 is a diagram to help explain still another 
example of the recording data structure on a 

25 recordable/reproducible information medium; and 
FIG. 12 is a diagram to help explain still another 
example of the recording data structure on a 
recordable/reproducible information medium. 

30 Best Mode for Carrying Out the Invention 

[0013] Hereinafter, referring to the accompanying 
drawings, an embodiment of the present invention will 
be explained. FIG. 1 illustrates the relationship between 
35 the Individual information files and management infor- 
mation about them in an embodiment of the present 
invention. 

[0014] As shown in FIG. 1(i), audio information is 
recorded in a file RTR_AUD.VRO (or AR_AUDIO.ARO) 

40 114. Video information is recorded in a file 
RTR_MOV,VRO (or VR_MOVIE.VRO) 107 as shown in 
FIG. 1 (o), and still picture information is recorded in a 
file RTR_VRO (or VR_STILL.VRO) 108 as shown in 
FIG. 1 (I). Management information for managing inte- 

45 grally these types of information has been recorded in a 
navigation data file RTR.IFO (or AR^MANGR.IFO) 104 
shown in (a) to (0 of FIG. 1 . 

[0015] All or part of the contents of the records of 
video information, still picture information, and audio 

50 infomnation can be expressed in logical units called pro- 
gram chains (PGCs). The PGC is composed of one or 
more cells to be reproduced and program chain infor- 
mation (PGCI) in which its playback sequence and oth- 
ers have been written. On the other hand, a program 

55 (PG) is a logical unit obtained by dividing the contents of 
a PGC, One PGC can be divided into an integral 
number of PGs. One PG is composed of an integral 
number of cells. 



3 



BNSDOCID: <EP 1096489A1J_> 



5 



EP 1 096 489 A1 



6 



[0016] When what has been described above is 
applied to the illustrations of (a) to (c) of FIG. 1, PGCI 
#1 . the original PGC, is connposed of an integral number 
of progranns #a, #p, #7. .... Program #a is composed of 
one cell #1 (movie cell) and program #3 is made up of 5 
two cells #2 and #3 (audio cells). Program #7 is com- 
posed of three cells #4 (still picture cell), #5 (silent cell), 
and #6 (audio cell). 

[0017] As shown in (c) and (d) of FIG. 1 , movie cell 
#1 corresponds to movie VOB information M_VOBI^2. 10 
The M_VOBI has time map information (TMAPI) 10, 
Similarly, audio cells #2, #3, and #6 correspond to 
A_VOBI #A-4, A_VOBI #B-4, and A_VOBI #C*6. 
These A_VOBI (#A to #C) have time map information 
12, 13, and 14, respectively. Still picture cell #4 corre- 15 
sponds to still picture VOB group information S_VOGI 3, 
The S^VOGI has VOB entry (S_VOB_ENT) 17. 
[0018] Video information compressed in MPEG 2 
constitutes a VOBU (video object unit) composed of one 
or more GOPs (group of pictures). The VOB is the 20 
smallest unit in video information access. A TV program 
or the like recorded (video-recorded/audio-recorded) 
generally constitutes, in the from of a block of video 
information, a M_VOB (movie video object) 31 com- 
posed of a plurality of VOBUs (VOBU No. 1 . VOBU No. 25 
2, VOBU No. 3, ... in FIG. 1(m)) (FIG. 1 (n)). In the 
RTR.IFO 104 in which management information has 
been recorded, M_VOBI (movie video object informa- 
tion) 2 in which information about each M„VOB has 
been written is present. Information called time map 10 30 
is present for each M_VOBI. 

[0019] As for still picture infonmation. a still picture 
VOB 21 (FIG. 1(k)) is constructed for each still picture. 
Then, as shown in FIG. 1Q), the still picture itself has 
been recorded on a video part 22 and the audio infor- 35 
mation added to the still picture has been recorded on 
an audio part 23. Still picture video object group infor- 
mation (S_VOGI in FIG. 1 (d)) 3 is formed for each group 
of one or more still pictures recorded on the video part 
22. In a VOB entry (S_VOB_ENT) 17 included in the 40 
S_VOGI, information including the data size of each still 
picture has been recorded. 

[0020] In a RTR.AUD.VRO 114 file (FIG. 1(i)) in 
which audio information has been recorded, recording 
information is divided and recorded in the form of indi- 45 
vidual audio video objects A_VOBs (or audio objects 
AOBs) for each title (each piece of music in recording) 
or for the timing of each recording session (#A to #C in 
FIG. 1(h)). 

[0021] Information about each A_VOB (or AOS) is so 
recorded in audio video object information A_VOBI (or 
audio object information AOBI). The audio information 
recorded on the information medium is divided into a 
plurality of audio frames or into audio entries at specific 
time intervals in video-recording, such as 1 -second 55 
intervals. 2-second intervals, or 5-second intervals. 
[0022] Information about time maps 1 2 to 1 4 in FIG. 
1(d) has been recorded in each A_VOBI (#A to #C) in 



such a manner that the information relates to individual 
audio entries No. 1 to No. 5 (or time search table entries 
TMSRT_entry #1 to TMSRT_entry #5) in FIG. 1(g). In 
other words, in the embodiment of FIG. 1(g), the audio 
information has been recorded audio entry by audio 
entry (or time table entry by time table entry). 
[0023] In the embodiment of FIG. 1, as with the 
video information (movie VOB 31 in FIG. 1(n)) in the 
existing RTR standard, cells #2. #3. and #6 have been 
defined which specify the playback range from the start 
position to the end position for the individual audio 
VOBs (AOBs) #Ato #C. This enables the audio infomna- 
tion (audio VOB #A to VOB #C) to be handled in totally 
the same manner as cell #1 that has specified the play- 
back range from the start position to end position of 
video information (movie VOB 31) or cell #4 that has 
specified the playback range from the start position to 
end position of still picture information (still picture VOB 
21). This is one of the characteristics of the present 
invention. 

[0024] It is safe to say that the original PGC is infor- 
mation indicating the procedure for reproducing all the 
AV infomnation recorded on an information medium as if 
the medium were a single tape. The playback sequence 
information has been written in program chain informa- 
tion (PGCI #1) shown in FIG. 1(a). The contents of the 
infomnation in PGCI #1 indicate the order in which cells 
are an^nged as shown in FIG. 1(c). To reproduce the 
original PGC, the cells arranged in FIG. 1(c) are repro- 
duced in sequence from the left. In this way, use of the 
PGCI information clarifies the connection (the playback 
sequence) between video information, still picture infor- 
mation, and audio infomnation, 

[0025] In the embodiment. PGCI #1 of FIG. 1(a) is 
defined as the only original PGC in RTR.IFO (or 
AR_MANGR.IFO) 104. An n number (an integral 
number) of PGCI #n that the user has determined arbi- 
trarily are defined as user-defined PGCs (FIG. 1 (f)). The 
number of user-defined PGCs may be more than one. 
The playback sequence of them can be expressed by 
the order in which cells #1 1 to #13 are arranged in FIG. 
1(e). The cells #11 to #13 present under the user- 
defined PGC can be set to specify any range in each 
VOB by making use of the time maps 10 to 14, as the 
need arises. 

[0026] In other words. In A_VOBI #A4 to A_VOBI 
#C6. management information about audio information, 
the time maps 12 to 14 of FIG. 1(d) are provided. The 
cells #11 to #13 present under the user-defined PGC 
can specify the playback range (specify the time) using 
the information in the time maps 12 to 14. 
[0027] In the embodiment, cell type information is 
given to the cell information corresponding to each cell 
as shown in FIG. 1(c), thereby making it possible to dis- 
tinguish between video information (movie cells), still 
picture information (still picture cells), and audio infor- 
mation (audio cells). 

[0028] The correspondence between the video 



4 



: <EP 1096489A1J_> 



7 



EP 1 096 489 A1 



8 



information (nnovie cells), still picture information (Still 
picture cells), audio information (audio cells), and audio 
+ video or still picture information (composite cells) and 
the cell types (three bits) can be set as follows: for 
example. 

movie cell: cell type = "000" 
still picture cell: cell type = "001" 
audio cell: cell type = "010" 
composite cell: cell type = "011" 

[0029] The above cell types are illustrative and not 
restrictive. For instance, the cell type of audio cells (as 
long as it is not confused with the other cell types) may 
be any one of "000" to "1 1 1 / 

[0030] FIG. 2 is a diagram to help explain the direc- 
tory structure of a data file according to an embodiment 
of the present invention. The information recorded on an 
information medium, such as a DVD-RAM disc has a 
hierarchical file structure for each piece of information. 
The audio information and others explained in the 
embodiment are included in a subdirectory 101 named 
DVD„RTR directory (or DVD.RTAV) 102. 
[0031 ] In the DVD_RTR (DVD_RTAV) directory 1 02, 
a data file 1 03 with the following contents is stored. Spe- 
cifically, as a group of management information (naviga- 
tion data). RTR.IFO (or VR_MANGR.IFO) 104. 
STREAM, IFO (SR„MANGR.IFO/SR_MANGR.BUP) 
105. and SR_PRIVT.DAT/SR_PRIVT.BUP 105a are 
stored. Moreover, as the content of the data (content 
information), STREAM. VRO (or SR_TRANS.SRO) 106. 
RTR_MOV.VRO (VR_MOVIE.VRO) 107. 

RTR^STO.VRO (or VR_STILL.VRO) 108, and 
RTR_STA.VRO (or VR^AUDIO.VRO) 109 are stored. 
[0032] In the root directory 100 at a higher level of 
hierarchy than that of the subdirectory 101 including the 
data file 1 03, a subdirectory 1 1 0 for storing other pieces 
of information can be provided. The contents of the sub- 
directory include a video title set VIDEO_TS 111 in 
which video programs have been stored, an audio title 
set AUDIO_TS 1 12 in which audio programs have been 
stored, and a subdirectory 113 for storing computer 
data. 

[0033] The data transmitted in the form of a packet 
structure over a cable or radio data communication path 
is recorded on an information medium, with the packet 
structure remaining unchanged. The resulting data is 
called "stream data." 

[0034] The stream data itself is recorded under the 
file name STREAM.VRO (or SR.TRANS.SRO) 106. A 
file in which management information about the stream 
data has been recorded is STREAM. IFO (or 
SR_MANGR.IFO and its backup file SR_MANGR.BUP) 
105. 

[0035] Furthermore, a file in which analog video 
information handled by VCR (VTR) or conventional TV 
and digital-compressed according to the MPEG 2 
standard has been recorded is RTR_MOV.VRO (or 



VR_MOVIE.VRO) 107. A file in which still picture infor- 
mation including postrecording sound or background 
music has been put together is RTR_STO.VRO (or 
VR_STILL.VRO) 108. Its after-recording audio informa- 

5 tion file is RTR.STA.VRO (or VR_AUDIO,VRO) 109. 
Moreover, In the directory structure of FIG. 2, all the 
audio information has been recorded in a single file 
named audio real-time video object RTR_AUD.VRO (or 
VR_AUDIO.VRO) 114. 

10 [0036] The directory structure of FIG. 2 is illustrative 
and all the audio Infonnation may be recorded in the 
RTR_STA.VRO 109 file in which the after- recording 
audio information has been recorded or in the audio 
part (FIG. 1(j)) of RTR_STO.VRO 108 in which the still 

15 picture information has been recorded. 

[0037] FIG. 3 illustrates the recording layout and 
position of each file on an information medium shown in 
FIG. 2. As shown in FIG. 3(b). a lead-in area 204 and a 
lead-out area 205 are provided on the inner edge part 

20 and outer edge part of an information medium 201 of 
FIG. 3(a). User data is recorded in the area sandwiched 
between the lead-in area and lead-out area. When a 
DVD-RAM disc is used as the information medium 201 . 
UDF (universal disc format) is used for the file system. 

25 General information on the UDF is recorded in volume & 
file structure information 206 and user information is 
recorded in the remaining part of the medium, a data 
area 207. 

[0038] As shown in FIG. 3(c), in the embodiment. 

30 computer data areas 208 and 209 and an audio & video 
data area 21 0 can be recorded in a mixed manner. 
[0039] As shown in FIG. 3(d), in the audio & video 
data area 210, a real-time video recording area 221 in 
which the inputted analog video information and/or 

35 audio infonnation are digital-recorded and a stream 
recording area 222 in which digital-TV received images 
are recorded can be provided. In the above individual 
areas (208 to 209), the files shown in FIG. 2 have been 
recorded in the form of FIG. 3. 

40 [0040] Management information about all the AV 
information including video information, still picture 
information, and audio information is all recorded in the 
same file named RTR.IFO 1 04 in FIG. 3(e) and is under 
common management. 

45 [0041] In the RTR.IFO 104. the various types of 
information shown in FIG. 3(f) have been recorded. 
Specifically, in the RTR.IFO 104, the following are 
recorded: RTR video manager information 
(RTR_VMG1) 231, a movie AV file information table 

50 (M_AVFIT) 232. a still-picture AV file information table 
(S_AVFIT) 237, an audio AV file information table 
(A_AVFIT) 238, original PGC information (ORG_PGC!) 

233. a user-defined PGC information table (UD_PGCIT) 

234. a text data manager (TXTDR_MG) 235. and a 
55 maker (or manufacturer) information table (MNFIT) 236, 

[0042] Although not shown, the still-picture AV file 
infonmation table (S_AVFIT) 237 can include still-picture 
additional audio file information (S_AAFI) and the 
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S_AAFI can include one or more pieces of still-picture 
additional audio group infomnation (S_AAGI #1 to 
S_AAGI #n). Each S_AAGI can include still-picture 
additional audio group general information (S_AAG_GI) 
and one or more additional audio entries (AA_ENT #1 
to AA_ENT #n). 

[0043] Here. S„AAG_GI is composed of the 
number of additional audio entries (AA_ENT_Ns), still- 
picture additional audio stream information number 
(S_AA_STIN), and the start address (S_AAG_SG) of 
the relevant additional audio group in a still-picture addi- 
tional audio file. 

[0044] Furthermore, each AA_ENT is composed of 
additional audio type (AA_TY), additional audio part 
size (AA_PART_SZ), the playback time of additional 
audio part (AA_PART_PB_TM). In the additional audio 
type (AA_TY), a 1-bit flag indicating whether the rele- 
vant additional audio is in the normal state (AA_TY = 
"0") or the temporarily erased state (AA_TY = "1") is 
stored. 

[0045] All the management information about the 
audio information has been recorded in the audio AV file 
information table 238 of FIG. 3(f). FIG. 3(g) shows an 
example of the contents of the records in the audio AV 
file infonmation table 238, original PGC information 
(0RG_PGC1) 233, and user-defined PGC information 
table (UD.PGCIT) 234. 

[0046] Audio VOB infomnation (A_VOBI #A) 242 of 
FIG. 3(g) corresponds to A_VOBl #A of FIG. 1(d) and 
audio VOB infomnation (A_VOBI #B) 243 of FIG. 3(g) 
corresponds to A_VOBl #B of FIG. 1(d). In addition, 
PGCI #1 (original PGC) of FIG. 1 (a) con-esponds to the 
original PGC information (ORG_PGCI) 233 of FIG. 3(f). 
The user-defined PGC (PGCI #n) of FIG. 1 (f) means the 
user-defined PGC information table (UD_PGC1T) 234 of 
FIG. 3(f). Moreover, the information in each of the time 
maps 12, 13, 14 shown in FIG. 1(d) is recorded in time 
map information 252 of FIG. 3(h). The detailed structure 
of the time map information is as shown in FIG. 3(i). 
[0047] Most pieces of the audio information have 
the smallest units called audio frames. In the embodi- 
ment, a plurality of audio frames are put together to fonn 
a unit called an audio entry. Information management is 
performed audio entry by audio entry on the time map 
information 252. 

[0048] In the method of forming an audio entry, 
audio information may be put together at specific time 
intervals, such as 1 -second intervals, 2-second inter- 
vals, or 5-second intervals, to form an audio entry, 
instead of putting a plurality of audio frames together as 
described above. The time interval information for 
putting audio entries together can be given to audio 
entry time difference 265 of FIG. 3(i). 
[0049] The audio information (music programs) is 
put together piece by piece of music or title by title to 
form an audio VOB (AOB). The number of entries 
included in each audio VOB is recorded in the number 
of audio entries 260. For the audio information recorded 



10 

in the RTR_AUD.VRO 114 file, the recording size of 
each audio entry included in each audio VOB can be 
recorded in a first audio entry data size 261, a second 
audio entry data size 262 

5 [0050] The number of audio entries 260 can have 
the contents corresponding to the AA_ENT_Ns in the 
S_AVF1T 237 or TMSRTE_Ns explained later by refer- 
ence to FIG. 5. In addition, each of the audio entry data 
sizes 261 . 262. and the like can have the contents cor- 

10 responding to the AA_PART_SZ in the S_AVFIT 237 or 
TMSRT_entry explained later by reference to FIG. 5. 
[0051] When the user or the like specifies the play- 
back time in an audio VOB (AOB), a check is made for 
the specified time to see which one in the order of the 

75 audio entries includes the audio information specified 
by the user or the like. Then, the first audio entry data 
size 261 , second audio entry data size 262, ... data size 
are added (accumulated), thereby calculating the posi- 
tion (the address corresponding to the playback start 

20 time) where the specified audio infomnation on the infor- 
mation medium 201 is recorded. 

[0052] While in the data structure of the time map 
information 252 shown in (h) and (i) of FIG. 3, the data 
size of each audio entry has been recorded, this is not 

25 restrictive and the accumulation position (address) 
information at the begin position of each audio entry 
may be given to the time map information 252. 
[0053] Furthermore, in the embodiment of FIG. 
1 (g), the audio information has been put together and 

30 recorded audio entry by audio entry. In another embod- 
iment of the present invention, there is provided a 
method of recording the audio information continuously 
instead of recording the audio information in blocks as 
shown in FIG. 1 (g). In this case, instead of having the 

35 time map information 252 information, entry point infor- 
mation 283 shown in FIG. 3(h) is used. 
[0054] Specifically, a data structure similar to that of 
the time map information of FIG. 3(i) is given to an audio 
start entry point setting area 2830 in the entry point 

40 information 283, thereby enabling the positions 
(addresses) in which the audio information (which can 
include silence infomnation) has been recorded at spe- 
cific time intervals, such as 1 -second intervals or 2-sec- 
ond intervals, to be recorded one after another as entry 

45 points 2832 indicating the audio start positions. 

[0055] Furthermore, time interval information simi- 
lar to the audio entry time difference 265 and/or the 
number of entry points similar to the number of audio 
entries 260 can be recorded in the entry point informa- 

50 tion 283. A method of calculating the access point on 
the information medium 201 for the audio playback start 
time specified by the user may be similar to the method 
used with the aforementioned time map information 
252. 

55 [0056] There are two types of cells in an audio-only 
object (audio-only title audio object AOTT_AOB): one is 
an audio cell and the other is a silent cell. An audio cell 
is composed of only audio data or of audio data and 
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real-time information data. The playback time of an 
audio cell is set to one second or longer. On the other 
hand, a silent cell is composed of only audio data for a 
silent period. The playback time of a silent cell is set to 
0.5 second or longer. 5 
[0057] In audio information (particularly, a music 
album including a plurality of pieces of music), the silent 
time between pieces of music is important during play- 
back. In the embodiment of the present invention, use of 
the silent cells makes it easy to set silent time infomna- io 
tion. 

[0058] for example, cell #5 shown in FIG. 1(c) has 
no corresponding silence information and is specified to 
be a silent cell in terms of cell type. Information about 
each cell type of FIG. 1(c) is recorded in the areas for is 
the cell types 280, 281 shown tn FIG. 3(h). As shown in 
FIG. 3(h). the structure is such that information on dis- 
play time 282 can be recorded as information in the 
original cell information 272. The silent period for the 
cell for which a silent cell has been specified can be set 20 
in the display time 282 information. 
[0059] In the cell types 280, 281 shown in FIG. 3(h), 
identification information (identification flag composed 
of a plurality of bits) for identifying the following can be 
written: video information 25 

(RTR_MOV.VRO/VR_MOVIE.VR0), still picture infor- 
mation 

(RTR_STO.VROA/R_STILL.VRO/AR_STILL.ARO),text 
information (AR_RT_TEXTARO), stream information 
(STREARM.VRO/SR_TRANS.SRO), audio Information 30 
(RTR_STA.VROA/R_AUDIO.VRO/RTR_AUD.VRO/AR_ 
AUDIO.ARO) and others. 

[0060] The method of setting a silent period is as 
follows. In the entry point infomnation 283 of FIG. 3(h), 
the setting area 2830 for an audio start entry point is 35 
provided. In the embodiment, audio information includ- 
ing a silent period in advance has been recorded in the 
audio VOB (AOB) of FIG. 1(h). The position at which a 
silent period ends and sound starts can be recorded as 
time information in the audio start entry point 2832. 40 
When the user or the like wants to skip the silent period 
and start the playback directly from the audio start posi- 
tion, the information medium 201 has only to be 
accessed using the audio start entry point information. 
[0061] An embodiment of the present invention 45 
employs such a data structure as enables the already 
recorded audio information and still picture information 
or the already recorded video information and the audio 
information recorded at a different time to be repro- 
duced simultaneously using the user-defined PGC 8 of so 
FIG. 1(f). 

[0062] Specifically, as shown in FIG. 1(e). when a 
composite cell has been specified for a cell type, the 
simultaneous playback of two types of information is 
specified. To realize the simultaneous playback, the 55 
data structure of the user-defined cell information 277 
not only enables two VOB numbers 284. 285 to be 
specified independently but also has VOB start times 



286, 287, the playback start times of the respective 
VOBs, and information about VOB end times 288, 289, 
the playback end times, as cell infomnation. 
[0063] FIG. 4 is a diagram to help explain the con- 
figuration of an audio information recording/reproducing 
apparatus (an RTR video recorder and/or streamer with 
an expanded audio recording/reproducing function) 
according to an embodiment of the present invention. 
Hereinafter, using FIG. 4, the internal structure of the 
audio information recording/reproducing apparatus will 
be explained as a preferred embodiment of the present 
invention, 

[0064] The audio infonnation recording/reproducing 
apparatus of the present embodiment comprises an 
encoder section 401 . a decoder section 402. an STB 
section 403, a main MRU section 404. a V (video) mix- 
ing section 405, a frame memory section 406, a key 
input section 407, a display section 408, a disc drive 
section 409 for recording or reproducing information 
onto or from a DVD-RAM disc 201 . a data processor (D- 
PRO) section 41 0. a temporary storage section 41 1 , an 
AA/ (audioA/ideo) input section 41 2, and a TV tuner sec- 
tion 413. The audio information recording/reproducing 
apparatus further comprises a satellite antenna 421 
connected to the STB section 403, a system time coun- 
ter (STC) section 424, an interface (1/F) 434 for sending 
a digital video signal from the V mixing section 405 to a 
personal computer (PC) 435, and a D/A conversion sec- 
tion 436 for an analog TV 437. 

[0065] The V mixing section 405 has the function of 
mixing the digital video signal from the V-PRO section 
438 of the decode section 402 with the digital video sig- 
nal 423 from the STB section 403, as the need arises. 
The mixing function makes it possible to display not only 
the broadcast image from the STB section 403 on the 
left side of the display screen of the TV 437 but also the 
image reproduced from the disc 201 on the right side of 
the display screen of the TV 437. Alternatively, the mix- 
ing function makes it possible to display the broadcast 
image from the STB section 403 and the image repro- 
duced from the disc 201 on the monitor screen of the 
PC 435 in such a manner that they are superimposed 
one on top of the other on an overlapping window. 
[0066] With the above configuration, the encoder 
section 401 is composed of a video and audio A/D con- 
version section 414, a selector 415 for choosing 
between the digital video signal from the A/D conversion 
section 414 and the digital video signal 423 from the 
STB section 03 and sending the selected signal to a 
video encode section 416. the video encode section 
416 for encoding the video signal from the selector 41 5, 
an audio encode section 41 7 for encoding the audio sig- 
nal from the A/D conversion section 414, an SP encode 
section 418 for encoding the closed caption (CO) signal 
from the TV tuner section 413 or a broadcast signal or 
the like into sub-pictures (SP). a formatter section 419, 
and a buffer memory section 420. 
[0067] On the other hand, the decode section 402 is 
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composed of a separation section 425 containing a 
memory 426. a video decode section 428 containing a 
reduced picture (thumbnail picture) creation section 
439, an SP decode section 429, an audio decode sec- 
tion 430. a transport stream packet (TS packet) transfer 
section 427. a video processor (V-PRO) section 438. 
and an audio D/A conversion section 432. 
[0068] The digital audio signal decoded at the 
decode section 430 can be outputted to the outside 
world via an interface (l/F) 431, The digital audio signal 
is converted by the D/A conversion section 432 into an 
analog audio signal, which passes through an external 
audio amplifier (not shown) and drives a speaker 433. 
The D/A conversion section is designed to be capable of 
perform D/A conversion of not only the digital audio sig- 
nal from the audio decode section 430 but also the dig- 
ital audio signal 422 from the STB section 403. 
[0069] When the playback data from the disc 201 is 
transferred to the STB section 403, the TS packet trans- 
fer section 427 has only to change the playback data (bit 
stream) from the separation section 425 into transport 
packets (TS packets) and send the TS packets to the 
STB section 403 in such a manner that the transfer time 
is adjusted to the time information from the STC 424. 
[0070] The main MPU section 404 of FIG. 4 
includes a work RAM 404a acting as a work memory, a 
control program named a stream data (or RTR data) 
creation control section 404b, a control program named 
a stream data (or RTR data) playback control section 
404c, and a control program named a stream data (or 
RTR data) partial erase/temporary erase control section 
404d. 

[0071] To read and write data from and into the 
management area (RTR.IFO 104 or STREAM. IFO 105 
in FIG. 2 or FIG. 3(e)) of a file, the main MPU section 
404 is connected to the D-PRO section 410 via a dedi- 
cated microcomputer bus. 

[0072] In the audio information recording/reproduc- 
ing apparatus, control in recording (audio-recording and 
video-recording) is performed by the main MPU section 
404 using the control program (sequential control pro- 
gram). Rrst, the flow of the video signal in recording 
(audio- recording and video-recording) in the apparatus 
of FIG. 4 will be explained. In video-recording, a series 
of processes is carried out according to the sequential 
program named the stream data (or RTR data) creation 
control section 404b in the main MPU section 404. 
[0073] Specifically, the stream data (or RTR data) 
sent from the STB section 403 to the encode section 
401 by way of a transmission path complying with the 
IEEE 1394 standard is first transferred to the fonnatter 
section 419. The IEEE 1394 reception side of the for- 
matter section 41 9 reads the time from the stream data 
(or RTR data) transfer start on the basis of the time 
count value in STC 424. The read-in time information is 
sent as management information to the main MPU sec- 
tion 404, which stores the information in the work RAM 
section 404a. 



[0074] The main MPU section 404, on the basis of 
the time information, creates division information for 
segmenting the stream data (or RTR data) stream block 
by stream block (VOBU by VOBU in a real-time RTR 

5 recorder or SOBU by SOBU in a streamer). The main 
MPU section 404 further creates cell segmentation 
information, program segmentation information, and 
PGC segmentation information corresponding to the 
division infonmation and records the resulting pieces of 

10 information in the work RAM section 404a in the main 
MPU section 404 one after another. 
[0075] The formatter section 419 converts the 
stream data (or RTR data) sent from the STB section 
403 into pack trains according to instructions from the 

15 stream data (or RTR data) creation control section 404b 
in the main MPU section 404 and inputs the converted 
pack trains to the D-PRO section 410. Each inputted 
pack has a constant size of 2048 bytes as a sector has. 
The D-PRO section 410 puts the inputted packs 

20 together in units of 1 8 sectors to form ECO blocks and 
sends the ECC blocks to the disc drive section 409. 
[0076] When the disc drive section 409 is not ready 
to record data on the RAM disc (infomnation medium) 
201. the D-PRO section 410 transfers the recording 

25 data to the temporary storage section 41 1 , which stores 
the data temporarily The D-PRO section 410 waits for 
the disc drive section 409 to be ready for data recording. 
Here, the temporary storage section 411 is assumed to 
have a large capacity memory to enable high-speed 

30 access and the storage of more than several minutes of 
recording data. 

[0077] After the disc drive section 409 is ready for 
recording, the D-PRO section 410 transfers the data 
stored in the temporary storage section 41 1 to the disc 

35 drive section 409. This starts to record the data onto the 
disc 201 . After the data stored in the temporary storage 
section 41 1 has been recorded, the formatter section 
419 transfers the rest of the data seamlessly to the D- 
PRO section 410. 

40 [0078] Next, data processing in playback will be 
explained- In control during playback in the audio infor- 
mation recording/reproducing apparatus, the main MPU 
section 404 carries out a series of processes according 
to the sequential program named the stream data (or 

45 RTR data) playback control section 404c. 

[0079] First, the disc drive section 409 reproduces 
the stream data (or RTR data) from the RAM disc (infor- 
mation medium) 201. The reproduced data is trans- 
fenred to the decoder section 402 by way of the D-PRO 

50 section 409. In the decoder section 402. the separation 
section 425 receives the packets in the reproduced 
data. 

[0080] The separation section 425 transfers the 
video packet data (MPEG video data) to the video 
55 decode section 428, the audio packet data to the audio 
decode section 430, and the sup-picture packet data to 
the SP decode section 429. 

[0081 ] The video data decoded at the video decode 
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section 428 passes through the V mixing section 405 
and D/A conversion section 436, which convert the 
decoded video data into an analog TV signal. The ana- 
log TV signal is transferred to the TV 437, which dis- 
plays an image from the analog TV signal, 
[0082] At the same time, the audio signal decoded 
at the audio decode section 430 is sent to the D/A con- 
version section 432, which converts the decoded audio 
signal into digital audio data. The converted digital 
audio data is transferred via the l/F 431 to the digital 
input of an external audio apparatus (not shown). Alter- 
natively, the converted digital audio data is converted by 
the D/A conversion section 432 into an analog audio 
signal and sent to the speaker 433 via an audio ampli- 
fier (not shown). 

[0083] In the audio information recording/reproduc- 
ing apparatus of FIG. 4, the AA/ input section 41 2 inputs 
the audio information. After the A/D converter 414 con- 
verts the audio information into a digital signal, the dig- 
ital signal is inputted to the audio encode section 41 7 by 
way of the selector 415. In a first step of recording, the 
inputted audio information is recorded additionally in the 
RTR_AUD.VRO 114 file on the infonnation medium 
201. Simultaneously with the recording, the main MPU 
section 404 creates management information about the 
recorded audio information in real time. After the audio 
information has been recorded, cell information and/or 
PGCI information as shown in FIG. 3 are changed or 
created additionally. Thereafter, RTR_IFO 104 is rewrit- 
ten on the basis of the management infonmation includ- 
ing the changed or additionally created cell infomnation 
and/or PGCI information. 

[0084] FIG. 5 shows the relationship between the 
data structure of the time search table for storing the 
time search table entries corresponding to the audio 
entries of FIG. 1 and the addresses (playback positions 
or playback times) of the audio objects (AOB), the con- 
tents of the recorded audio information. 
[0085] An audio object AOB (or audio VOB) is com- 
posed of a collection of AOB elements (or audio object 
units AOBUs) of a specific data size. The addresses 
(playback positions or playback times) of these AOB 
elements can be expressed by the values obtained by 
accumulating the data sizes of a series of AOB ele- 
ments. 

[0086] The data size of each AOB element can be 
expressed by the number of difference bytes written in 
the corresponding time search table entry 
(TMSRT_entry #1 to TMSRT_entry #n). These TMSRT 
entries (TMSRT_entry #1 to TMSRT_entry #n) and time 
search table header (TMSRT_H) are put together into 
the time search table (TMSRT). 

[0087] Specifically, the time search table TMSRT is 
made up of one or more TMSRT elements (#1 to #n), 
which are not only information indicating the sizes of the 
AOB elements in an AOB but also management infor- 
mation for the time search table header TMSRT_H and 
each AOB element. 



[0088] The header TMSRT_H in the time search 
table TMSRT is made up of an identifier TMSRT^ID for 
TMSRT, the total number of TMSRT entries 
TMSRTE_Ns, and others. The TMSRTE_Ns corre- 

5 spends to the number of audio entries 260 in FIG. 3(i). 
[0089] Each of the TMSRT entries (TMSRT_entry 
#1 to TMSRT_entry #n) includes TMSRT_ENT indicat- 
ing the data size of the corresponding AOB entry in the 
number of bytes. The TMSRT_ENT corresponds to the 

10 audio entry data sizes 261 , 262 in FIG. 3(i). 

[0090] In the embodiment, the data size (the 
number of bytes) written in the time search table 
TMSRT corresponds to playback time at 2-second inter- 
vals. 

75 [0091] FIG. 6 is a flowchart to help explain an 
example of the procedure for recording information 
according to the present invention. The procedure can 
be executed on, for example, the main MPU 404 of FIG. 
4. In recording, for example, the medium 201 of FIG. 3 

20 can be used. 

[0092] The RTR data or stream data suitably includ- 
ing video information, still picture information, text infor- 
mation, stream information and/or audio information is 
recorded in the real-time video recording area 221 or 

25 the stream recording area 222 of FIG. 3(d) (step ST1 0). 
in the embodiment, it is assumed that, at step ST10, 
audio information and other types of information (video 
infonnation, still picture information, text infomnation, 
and stream information) are recorded in a mixed man- 

30 ner. Recording information in step ST10 includes not 
only a case where new video-recording is done but also 
a case where part of the record is erased in editing or a 
case where the record is rewritten by overwriting an 
erasable part. 

35 [0093] After information recording (including partial 
erasing and rewriting) at step STIO has been com- 
pleted, the management information 
(RTR.IFO/VR„MANGR.IFO in FIGS. 1 to 3; 
STREAM.IFO/SR_MANGR.lFO in FIGS. 2 and 3; or 

40 AR_MANGR.IFO in FIG. 7) is written additionally to the 
management area or is changed and recorded (rewrit- 
ten) in the management area according to the recording 
(partial erasing and rewriting) (step ST12). 
[0094] Specifically, infomnation (original PGC infor- 

45 mation and/or user-defined PGC information) about the 
relationship between the audio information and the 
other information (information including video informa- 
tion, still picture information, text information, and 
stream information) in reproducing the recorded audio 
. 50 infomnation is written additionally or changed and 
recorded in the management area. 
[0095] FIG. 7 is a diagram to help explain another 
example of the directory structure of a data file. In the 
root directory 200X. DVD_RTAV directory 21 OX serving 

55 as a subdirectory and another subdirectory are pro- 
vided as the need arises. In the subdirectory 21 OX, 
information about each object (content information) is 
recorded in an independent file for the contents of each 
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object. 

[0096] Content information about audio and video is 
called an object. As shown in FIG. 7, video content 
information is recorded in a VR_movie object recording 
area 1 31 X and audio content information is recorded in 5 
an AR_audio object recording area 133X. Moreover, 
content information about still pictures is recorded in an 
AR_stilt picture object recording area 132X and content 
information about real-time text is recorded in an 
AR_real-time text object recording area 134X. All the io 
audio information is recorded in a file named 
AR_AUDIO.ARO 221 X, all the still picture information 
(still picture) is recorded in a file named AR_STILL.ARO 
21 3X, and all the real-time text information Is recorded 
in a file named AR_RT_TEXTARO 222X. i5 
[0097] In an embodiment of the present invention, a 
scene of pictures in a video information file defined 
according to the video recording standard can be 
extracted as a still picture. The extracted stiil picture can 
be displayed simultaneously with the audio information. 20 
An video information file VR_MOVIE.VRO 21 2X used at 
that time is also recorded in the same DVD_RTAV direc- 
tory 21 OX. The information in a management informa- 
tion recording area 130X for managing these object files 
comprehensively is recorded in a file named 25 
AR_MANGRJFO 21 1X and its backup file 
AR_MANGR.BUP 21 5X. 

[0098] The frame of the data structure of the man- 
agement information recorded on an information 
medium on or from which audio-related information can 30 
be recorded or reproduced is designed to have the 
same structure as that in the video recording standard 
determined in a DVD forum from the viewpoint of the 
importance of interchangeability. As in the video record- 
ing standard determined in a DVD forum, the informa- 35 
tion indicating the procedure for reproducing the audio- 
related information has been recorded in the original 
PGC information/user-defined PGC information. 
[0099] The smallest basic unit capable of continues 
playback in the audio-related information is called a cell. 40 
The playback procedure showing the connection of the 
cells is composed of PGC. All the management informa- 
tion about cells is recorded in one or more pieces of cell 
information recorded in the management information 
recording area 1 SOX. Information indicating what part of 45 
the file AR_AUDIO.ARO 221 X in which the audio infor- 
mation has been recorded is reproduced in one cell has 
been recorded in the cell information. The procedure for 
reproducing the audio-related information according to 
one piece of PGC infomnation is determined by the so 
order of arrangement of one or more pieces of cell infor- 
mation constituting the PGC information. Playback and 
display are executed in the order of the arrangement. 
[0100] Playback procedure information about the 
audio-related information includes the following two 55 
playback procedures: 

(1) A playback procedure for reproducing the data 



in the order in which the data has been recorded on 
the information medium. 

(2) A playback procedure that the user can specify 
arbitrarily. 

[0101] Management information about the playback 
procedure for "reproducing the data in the order in 
which data has been recorded" is called "original PGC" 
and can be named "original track" by the user. Manage- 
ment information about the playback procedure "the 
user can specify arbitrary" Is called "user-defined PGC 
and can be named "play list" by the user. 
[0102] Although one information medium can have 
only one original PGC, more than one user-defined 
PGC can be set in one information medium. Manage- 
ment information about each user-defined PGC is 
recorded in a plurality of pieces of user-defined PGC 
Information (FIG. 3{f)). These pieces of user-defined 
PGC information are managed centrally in the user- 
defined PGC information table (UD_PGCITI). Specifi- 
cally, the UD_PGCITI shows what user-defined PGC 
information has been recorded in this table. Information 
for searching for these pieces of user-defined PGC 
information can be recorded in the management infor- 
mation as user-defined PGC information search point- 
ers. 

[0103] Such an audio information medium as a CD 
(compact disc), an MD (minidisc), or a cassette tape 
has a management unit called "track" set for each piece 
of popular music or for each piece of classical music. 
When the play list (user-defined PGC) is created, for 
example, the user may combine part of the original track 
named "A" with part of the original track named "B" to 
create a new track named "C." 

[0104] A single cell can specify only a continuous 
playback range in AR_AUDIO.ARO 221 X, an audio 
information file (playback ranges that are consecutive 
but not continuous or are discrete in AR_AUDIO.ARO 
221 X cannot be specified). In this case, for example, 
part of the original file named "A" is specified in a single 
(user-defined) cell #1 , part of the original file named "B" 
is specified in another single (user-defined) cell #2. a 
combination of cell #1 and cell #2 enables a new track 
named "C" to be defined and managed. Specifically, 
with the data structure related to an embodiment of the 
present invention, a combination of one or more cells 
can constitute one track. 

[0105] To secure the compatibility with the video 
recording standard determined in a DVD forum, a 
method of determining the divisions of tracks peculiar to 
the audio infonmation. while holding the data structure, 
is such that information indicating the positions of 
breaks in a track for audio information can be recorded 
in the PGC information, information indicating the play- 
back procedure, in the embodiment of the present 
invention. 

[0106] To realize this method, an infonnation 
recording area called track head entry point is allowed 
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to be set in the cell information, management infomna- 
tion about the cell present In the playback start position 
of each track. In the track head entry point, infonnation 
inherent to a track is recorded. 

[01 07] The type of the track entry point is track head 5 
entry point or program information. 
[0108] The contents of the information in the entry 
point include entry point type information (identification 
infonnation for discriminating between track head entry 
point, and still picture entry point), information for spec- io 
ifying the display range of the representative sound indi- 
cating the contents of the corresponding audio track 
(specified by the playback start time and playback end 
time in the corresponding audio track), and information 
for specifying the storage location of the representative 75 
image representing the contents of the corresponding 
audio track (specified by S_VOGI number and the VOB 
entry number in the location). In addition, the contents 
further include text information (primary text in which 
the names of pieces of music, the names of performers, 20 
the names of singers, the names of composers, and 
others have been written) inherent to the corresponding 
audio track, additional explanatory text information (item 
text), the display mode of a still picture in the corre- 
sponding audio track (the display sequence mode, dis- 25 
play timing mode, and others), display time range 
information about the corresponding still picture, the 
relationship between the contents of the still picture to 
be displayed and the original track (whether the same 
still picture as that on the original track or another inde- so 
pendent still picture (newly set still picture) is displayed), 
and an erase inhibit flag. 

[0109] Furthermore, the still picture entry point 
includes entry point type information (identification infor- 
mation for discriminating between track head entry point 35 
and still picture entry point), information for specifying 
the storage location for a still picture to be displayed 
(specified by the S_VOGI number and the VOB entry 
number in the location), infonmation for specifying the 
timing for displaying the still picture (information for 40 
specifying display time Information about the corre- 
sponding audio object to adjust the display timing 
between them), and the display time range information 
about the corresponding still picture. Another piece of 
information may further be added to these pieces of 45 
information. 

[0110] Instead of using the track head entry point, 
-flag information indicating that the corresponding cell 
has been located at the head position of the track" may 
be recorded in the cell information about the ceil posi- so 
tioned at the head of the track. In this case, for example, 
-flag = r can indicate that the corresponding cell is 
present at the head position of the track, and "flag = 0" 
can indicate that the corresponding cell is present on 
the second or later track. 55 
[0111] Furthermore, simultaneous display setting 
information for doing setting to display audio information 
and still picture information at the same time may be 



written in the cell information. 

[0112] FIG. 8 Is a diagram to help explain still 
another example of the recording data structure on a 
recordable/reproducible information medium. As shown 
in (c) to (e) of FIG. 8, in a management information 
recording area 130X for an audio-and-video-related 
infonnation recording area 121 X, the following are 
recorded: RTR audio manager information 
(RTR_AMGI) 140X, a movie AV file information table 
(M_AVFIT) 141X, a still picture AV file infonnation table 
(S_AVFIT) 142X, an audio file information table 
(A_AVFIT or AUD_FIT) 143X, original PGG information 
(ORG_PGCI) 144X. a user-defined PGG information 
table (UD_PGCIT) 145X, a text data manager 
(TXTDT_MG) 146. maker information table (MNFIT) 
147X, and others. 

[0113] Management information about the audio 
infonnation in the AR_AUD10.AR0 221 X file shown in 
FIG. 7 has been recorded in the audio AV file informa- 
tion table (A_AVFlTor AUD^FIT) 143X of FIG. 8(e). (e) 
to (i) of FIG. 8 show hierarchically the audio AV file infor- 
mation table 143X, management infonnation about 
audio. 

[0114] As shown in FIG. 8(f). the audio AV file infor- 
mation table (A_AVFIT or AUD_F1T) 143X is composed 
of audio AV file information table information 
(AUD_FIT1) 1 SOX, one or more pieces of (a k number of) 
audio object stream information (AUD_STI #1 to 
AUD_STI #k) 181X to 182X, audio AV file information 
(AUDFI) 184X, one or more pieces of real-time text 
object stream information 186X, and real-time text AV 
file information 1 89X. 

[0115] As shown in FIG. 8(g), the audio AVfile infor- 
mation (AUDFI) 1 84X is composed of audio AV file gen- 
eral information (AUDFI_GI) 190X, one or more audio 
object Information search pointers {AOBI_SRP #1 to 
AOBLSRP #i) 1 91 X to 1 92X, and one or more pieces of 
audio object information (AOBl #1 to AOBI #i) 196X to 
197X. 

[0116] Each piece of audio object information (e.g., 
AOBI #1) is composed of audio object general informa- 
tion (AOB_GI) 240X and one or more audio object unit 
entries (AOBU_ENT #1 to AOBU.ENT #h) 241 X to 
248X as shown in FIG. 8(h). 

[0117] As shown in FIG. 8(1), each audio object unit 
entry (e.g., AOBU #1) is composed of an audio object 
unit data size (AOBU_S2) 251 X, audio object unit pres- 
entation time (AOBU_PB_TM) 252X, and a real time 
text position (difference address) 253X. 
[0118] Each piece of audio object information 
(AOBI) of FIG. 8(g) may be composed of audio object 
general information (AOB_GI) and audio object unit 
infonnation (AOBUI) (not shown). 
[0119] In this case, although not shown, the audio 
object general information (AOB_GI) may be composed 
of AOB_TY indicating the form of the corresponding 
AOB (the target audio object) (not shown), 
AOB_REC_TM indicating the recording time of the cor- 
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responding AOB, AOB_REC_TM_SUB indicating infor- 
mation on the time equal to or shorter than one second 
(subsecond infonnation) for the AOB_REC_TM, 
AUD_STIN indicating the audio stream information 
number of the corresponding AOB, AOB_A_S_PTM 5 
indicating the playback start time of the first audio frame 
in the corresponding AOB, AOB_A_E_PTM indicating 
the playback end time of the last audio frame In the cor- 
responding AOB, and SCR_DIFF indicating the differ- 
ence between the preceding AOB written in a system w 
clock reference (SCR) and the corresponding AOB. 
[0120] The audio object unit information (AOBUI) is 
composed of audio object unit general information (not 
shown) (AOBU_GI), and one or more audio object unit 
entries (AOBU_ENT #1 to AOBU_ENT #h) of FIG, 8(h). is 
[0121] Although not shown, the audio object unit 
general information (AOBU_GI) may include 
AOBU_PB_TM (corresponding to 252X in FIG. 8(i)) 
indicating the playback time of an audio object unit 
(AOBU), the AOBU's size AOBU_S2 (corresponding to 20 
251 X in FIG. 8(1)), L_AOBU_PB_TM indicating the play- 
back time of the last AOBU in the corresponding AOB 
(the target audio object), L_AOBU_SZ indicating the 
size of the last AOBU, AOBU_ENT_Ns indicating the 
number of AOBU entries (an h number of AOBU entries 25 
in the example of FIG. 8(h)). and AOB_SA indicating the 
start address of the corresponding AOB, 
[0122] Management information for the real-time 
text information (real-time text object; information 
whose contents of display vary in synchronization with 30 
audio information) written in AR_RT_TEXTARO 222X 
file of FIG. 7 can be recorded in (one or more pieces of) 
real-time text object stream information 1 86X and real- 
time text AV file infonnation 189X in the audio AV file 
information table 143X (FIG. 8(0). 35 
[0123] When audio infonnation Is recorded (audio- 
recorded) onto a disc-like information medium 100X, 
audio recording is often effected on a plurality of tracks 
at a time. In this case, the audio information unit to be 
recorded at a time is called audio object (AOB). The 40 
individual AOBs are provided with pieces of manage- 
ment information, pieces of audio object information #1 
to #i (196X to 197X of FIG. 8(g)). respectively. 
[0124] To enable high-speed playback (fast-for- 
ward) of audio information, rewinding (fast reverse), and 4S 
special playback, such as time search, the audio infor- 
mation is further divided into smaller data units (audio 
object unit AOBU) than AOB. Then, information about 
the data size (audio object unit data size 251 X of FIG. 
8(i)) in each data unit (AOBU) and the display required so 
time (audio object unit presentation time 252X) is 
recorded in the relevant recording locations of the audio 
object unit entries #1 to #h (241 X to 248X in FIG. 8(h)). 
[0125] The position information (relative 
address/difference address) in the AR_RT_TEXT.ARO 55 
222X file (FIG. 7) in which the real-time text information 
(real-time text object) displayed when the audio infor- 
mation at the head position in each data unit (AOBU) is 



reproduced has also been recorded in the audio object 
entries #1 to #h (241 X to 248X) as real-time text posi- 
tion information 253X. 

[0126] In each piece of cell information shown in 
FIG. 3(g), the number of AOB (audio object) spedfied 
by the relevant cell and the time information (start time 
and end time) for the relevant cell have been recorded. 
When the specified cell is reproduced, the cell within the 
time range specified in the specified AOB is repro- 
duced. Specifically, using the information in the audio 
object unit entries #1 to #h (FIG. 8(h)) recorded in the 
pieces of audio object information (AOBI) #1 to #i for the 
time information, the time range specified for playback 
is converted into relative addresses in AR_AUDIO.ARO 
221 X. Thereafter, the desired audio information is 
reproduced- 

[0127] Here, the playback start time can be 
selected arbitrarily. When the user specifies the corre- 
sponding track head entry point, playback can start from 
any track (a piece of music after editing). A still picture 
may be specified in such a manner that it is related to an 
audio track. 

[0128] FIG. 9 is a diagram to help explain still 
another example of the recording data structure on a 
recordable/reproducible information medium. Manage- 
ment information for the still picture information (still pic- 
ture object) to be displayed simultaneously in 
reproducing the audio information has been recorded in 
the still picture AV file infonnation table (S_AVFiT) 142X 
of FIG. 9(e). As shown in FIG. 9(f), the following area 
recorded in the S_AVFIT 142X: audio AV file infonna- 
tion table information (A_AVFITI) 26 OX, one or more 
pieces of still picture VOB stream infonnation #1 to #j, 
still picture AV file information (S_AVFI) 264X, and oth- 
ers. 

[0129] As shown in FIG. 9(g), the following are 
recorded in S_AVFI 264X: still picture AV file infonna- 
tion general information (S_AVFI_GI) 270X, one or 
more still picture VOB group information search pointers 
(S_VOGI_SRP) #1 to #g. one or more pieces of still pic- 
ture VOB group information (S_VOOGI) #1 to #g. and 
others. 

[01 30] When the still picture information is recorded 
on the information medium 1 COX. a plurality of pages of 
still picture information are often recorded at a time. A 
collection of pages of still picture information to be 
recorded at a time is called still picture VOB group 
(S_VOG). Management information about the still pic- 
ture VOB group is written in the pieces of still picture 
group information (S_VOGI) #1 to #g. On the basis of 
the management information, management is per- 
formed in still picture VOB groups. 
[0131] Specifically, each of the still picture VOB 
entries (S_VOB_ENT) #1 to #f (281 X to 289X in FIG. 
9(h)) in S_VOGI #1 to #g (273X to 279X in FIG. 9(g)) 
has a still picture VOB entry type (S_VOB_ENT_TY) 
291 X and a still picture size (the size of the video part 
V_PART_SZ) 292X as shown in FIG. 9(i). Use of these 
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pieces of information (S_VOB_ENT_TY. V_PART_SZ) 
enables nnanagement to be performed in still picture 
VOB groups. 

[0132] FIG. 10 is a diagram to help explain still 
another example of the recording data structure on a 
recordable/reproducible information medium. Infomna- 
tion peculiar to each track, including the name of a piece 
of music, the name of a singer, and the name of a per- 
former, can be recorded in the track head entry point 
(not shown) as text information. A place in which text 
information with a relatively small amount of data, such 
as the name of a piece of music, the name of a singer, 
or the name of a performer is recorded is a recording 
area (not shown) called primary text information in the 
track head entry point. 

[0133] In contrast, information that is peculiar to 
each track but cannot recorded in the primary text infor- 
mation because it has an enormous amount of data is 
allowed to be recorded in item texts (IT_TXT) #1 to #e 
(236X to 238X of FIG. 10(0). this case, in the track 
head entry pointer, only the pointer information 
(IT_TXT_SRP) with information indicating which one in 
the order of item texts is to be displayed is allowed to be 
recorded. 

[0134] The item text information, as shown in (e) 
and (f) of FIG. 1 0, is put together and recorded in a text 
data manager (TXTDT_MG) 146X. Recorded in the text 
data manager (TXTDT_MG) 146X are text data infor- 
mation (TXTDTI) 231 X, one or more item text search 
pointers (IT_TXT_SRP #1 to #e) 232X to 233X. one or 
more item texts (IT_TXT.#1 to IT_TXT #e) 236X to 
238X, and others. 

[0135] Stored in the text data information (TXTDTI) 
231 X, a character set CHRS, the number of item text 
search pointers IT_TXT_SRP_Ns, the end address of 
the text data manager TXTDT_MG_EA, and others. 
[0136] In each item text search pointer 
(IT_TXT_SRP #), the start address of the correspond- 
ing item text IT_TXT_SA, the size of the item text 
IT_TXT_SZ, and others are stored. In addition, each 
item text (239X in FIG. 10(g)) includes text written in the 
character code specified in the character set CHRS. 
These item texts may be called text information man- 
aged centrally at one place, or general text information. 
[0137] As shown in (e) and (f) of FIG. 10, all the 
item text information is recorded at the same time, facil- 
itating search, such as "text search", of the contents of 
all the item texts #1 to #e, which is helpful in making 
audio information search. 

[0138] FIG. 11 is a diagram to help explain still 
another example of the recording data structure on a 
recordable/reproducible information medium (an exam- 
ple of a case where audio index information is provided 
in the entry point information 283). The embodiment of 
FIG. 3(i) has illustrated the case where the position at 
which sound is started for the first time after a silent 
period has elapsed is specified in the entry point infor- 
mation 283. On the other hand, as one of its applica- 



24 

tions, more flexibility may be given to the entry point 
Information 283. This application will be explained using 
FIG, 11. 

[0139] The audio information, whose object is 

5 music, has a division unit of audio information called "a 
piece of music (song)." As an expression corresponding 
to the song, a division unit of audio information is called 
track (audio track). Furthermore, a specific segment in a 
track is called index. For example, when a track is 

10 caused to correspond to a symphony, a concerto, or a 
sonata in classical music, each movement corresponds 
to the index. Alternatively, when a popular song is 
caused to con-espond to a track, a position at which a 
block changes to another block in the song (for exam- 

15 pie. the first verse, second verse, and third verse of the 
song) can be caused to correspond to the index. 
[0140] Although explained in FIG. 3(i), "the position 
at which sound is started for the first time after a silent 
period has elapsed for the audio information including a 

20 silent period in one song" can be considered to be 
included in the index. Specifically, an expansion of a 
method/idea of using the step of specifying the first 
sound start position after the end of a silent period using 
the entry point information 283" is index specification or 

25 index designation. 

[0141 ] The data structure of the entry point informa- 
tion 283 of FIG. 1 1 (i) shows another embodiment of the 
data structure of the entry point information 283 of FIG. 
3(i). In the case of a structure with a plurality of entry 

30 points, information about pieces of entry point type for- 
mation 2834. 2835 are needed as shown in FIG. 1 1 (i) 
and FIG. 12(i) explained later 

[0142] In the embodiment of the present invention, 
the entry point structure of FIG. 11(i) enables "0101" or 

35 "0001" to be set as the entry point type information 
2834. In the case of the entry point structure of FIG. 
12(i), "001 0" is allocated as the entry point type informa- 
tion 2835, whereas in the case of FIG. 3(i), "0011" is 
allocated, thereby making it possible to discriminate a 

40 difference in the data structure. 

[0143] In a method of specifying an index, an index 
is specified by the playback time of audio information 
using the time map information (audio object unit entry 
point or audio entry) 252 shown in FIG. 1(g) or FIG. 

45 3(h). The playback time information is specified in entry 
point specifying time information 2831. The number cor- 
responding to a movement number in a symphony or a 
block number (the first verse, second verse, third verse, 
...) in a popular song is recorded as an index number 

50 2836. 

[0144] FIG. 12 is a diagram to help explain still 
another example of the recording data structure on a 
recordable/reproducible information medium (an exam- 
ple of a case where information indicating still picture 
55 infonnation to be displayed together with audio informa- 
tion has been provided in the entry point information 
283). 

[0145] In FIG. 3(h). the data structure that enables 
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audio information, still picture information, and others to 
be displayed simultaneously using composite cells has 
been explained. On the other hand, the present embod- 
iment employs a data structure that enables audio infor- 
mation and still picture information to be displayed 5 
simultaneously using the entry point information 283 as 
shown in (h) and (i) of FIG. 12. 

[0146] In the case of the structure of FIG. I2(i). 
"001 0" is set in the entry point type infomnation 2835. 
[0147] A still picture can be specified by the follow- 10 
ing steps of: 

(1) specifying any one of the pieces of still picture 
VOB group information #1 • 273 to #g • 279 by spec- 
ifying the number of S_VOGI search pointer of FIG. is 
9(g) according to S_VOGI search pointer number 
2837 and 

(2) further specifying still picture VOB entries 
#1 •281 to #f •289 of FIG. 9(h) according to a still 
picture VOB entry number 2838. 20 

[0148] The timing for displaying the specified still 
picture can be set by the audio information playback 
time in the same cell according to the entry point speci- 
fying time information 2831 of FIG. 12(i). 25 
[0149] In playback, the recording location of the 
audio object information recorded in AR_AUD10.AR0 
221X (FIG. 7) or RTR.AUD.VRO 114 (FIG. 2) corre- 
sponding to the above playback time can be searched 
for using the time map information for the audio informa- 30 
tion composed of the audio entries shown in FIG. 1 (g) or 
audio object unit entries (AOBU_ENT) shown in FIG. 
8(h). 

[0150] The entry point information 283 indicates 
time information. The stilt picture may be displayed at 35 
that time and continue being displayed until the play- 
back of the audio information in the same cell has been 
completed (or until the next stilt picture specified by the 
next piece of entry point information 283 has been dis- 
played). 40 
[0151] While in FIG. 3(h), FIG. 11(h), and FIG, 
12(h), only one piece of entry point information 283 has 
been recorded in one cell, this is not restrictive and 
more than one piece of entry point information 283 may 
be recorded in one cell. Furthermore, while in FIG. 3(h), 45 
FIG. 11(h), and FIG. 12(h), the entry point information 
283 has been recorded in cell information #1 • 272 in the 
original PGC information 233, this is not restrictive. For 
instance, the entry point information may be recorded in 
cell information #1 -277 in the user-defined PGC infer- so 
mation table 234. 

[0152] The method of using the entry point informa- 
tion 283 is given more flexibility by specifying or desig- 
nating not only the position at which sound is started for 
the first time after a silent period as shown in FIG. 3(i) 55 
but also an index number in the entry point information 
283 as shown in FIG. 1 1(i). 

[0153] For example, the searching or retrieval of the 
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head part of a user-favored track, the specification or 
designation of a movement changing position in a sym- 
phony, a concerto, or a sonata in classical music, or the 
block (e.g., the first verse, second verse, and third 
verse) changing position in a popular song, can be 
specified by an index number in the entry point informa- 
tion 283. As a result, the user can directly jump to the 
user-favored part of the same song (track) or to the 
user-favored block by specifying the index number in the 
entry point information 283 shown in FIG. 1 1 (i). 
[0154] When the user specifies a still picture using 
the entry point information 283 as shown in FIG. 12(i) 
instead of specifying two types of VOB at the same time 
in a composite cell as shown in FIG. 3(h), not only the 
contents of the management information can be simpli- 
fied, but also the editing processes, including partial 
erasing in songs and rearrangement, can be made sim- 
pler. 

[0155] As a concrete example, a case where the 
same cell is divided in two and the first half is erased will 
be explained. In the case of the composite cell of FIG. 
3(h), to synchronize the still picture with the audio infor- 
mation, it is necessary to change not only the first VOB 
start time 286 to the halved boundary time as the 
remaining part after erasing but also the second VOB 
start time 287. In contrast, when the data structure of 
FIG. 1 2(i) is used, it is necessary only to change the dis- 
play time 282 in the cell and erase the entry point infor- 
mation 283 corresponding to the erase range. 
[0156] Furthermore, when the entry point infomna- 
tion 283 is used in setting the still picture information to 
be displayed simultaneously with the audio information 
as shown in FIG. 12(i), the synchronizing of the audio 
information with the still picture information necessary 
for the data structure of FIG. 3(h) is unnecessary. 
[0157] In addition, when a still picture can be speci- 
fied using the entry point Information 283 as shown in 
FIG. I2(i), the display of the still picture can be set with 
an arbitrary timing for audio information playback. Spe- 
cifically, as shown in FIG. 1(j), in the VOB entry for a still 
picture, the display time interval for each still picture has 
been predetermined. As a result, when the composite 
cell structure shown in FIG. 3(h) is used, the display tim- 
ing for each still picture cannot be set arbitrarily for the 
playback time of the audio information. In contrast, 
when the data structure that determines the timing for a 
still picture to be displayed simultaneously with the play- 
back of the audio information using the entry point infor- 
mation 283 as shown in FIG. 12(i) is used, the display 
timing for each still picture can be set independently 
using the entry point specifying time information 2831. 
the playback time of the audio information. Conse- 
quently, the display time of a still picture can be speci- 
fied for an arbitrary audio information playback time. 
[0158] In the cell infonnation described in each of 
the above embodiments, simultaneous display setting 
infonnation for setting simultaneous display of the audio 
information and still picture information (or audio infor- 
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mation and video information) can be written. 
[0159] Furthermore, the application of the data 
structure illustrated in the embodiments of the present 
invention is not limited to the optical disc (the infonma- 
tion medium 201 or 100X in FIGS. 3 and 4 and FIGS. 8 
to 12), and may be applied to a solid-state memory 
(such as a large-capacity semiconductor flash mem- 
ory). 

[0160] The effects of the present invention 
described above are outlined as follows: 

1. As shown in (c) and (h) of FIG. 1, cells #2, #3, 
and #6 are defined for the individual audio VOB 
(AOB) #A to #C, respectively and cell type informa- 
tion is provided in the pieces of cell information cor- 
responding to the individual cells. The cell type 
information makes it possible to discriminate 
between the video information (movie cells), still 
picture information (still picture cells), and audio 
information (audio cells), which enables the audio 
information to be managed in totally the same man- 
ner as the video information and still picture infor- 
mation. As a result, not only can the digital audio 
information be recorded on an information medium 
in the same manner as the video information and/or 
still picture information, but also the data can be 
reproduced or edited from or on the information 
medium. 

As compared with the case where videotapes 
have been used for video information recording and 
MDs have been used for audio information record- 
ing, the present invention enables the video infor- 
mation and/or still picture information to be 
recorded in a mixed manner on a single information 
medium, which makes it possible for the user to 
record, reproduce, or edit audio/video/still-picture- 
mixed information with only one recording/repro- 
ducing unit. Furthermore, for example, the still pic- 
ture information is combined with the audio 
information differing from the former in recording 
time and then the resulting information is repro- 
duced, which gives a great flexibility to the playback 
method. 

2. An audio VOB (AOB) is defined for the audio 
information, and not only the cells equivalent to the 
video information and still picture information are 
caused to correspond to audio VOB (AOB), but also 
the original PGC information indicating the play- 
back sequence for the individual cells including the 
audio cells is provided in the audio VOB. With this 
setting, it seems to the user as if the video tnfonma- 
tion to be recorded on a videotape, the audio infor- 
mation to be recorded on an audio tape, such as a 
cassette tape, and the stili picture information to be 
recorded on a digital tape on which still picture 
information can be recorded were recorded in a 
mixed manner on a continues tape. By providing a 
mechanism for reproducing these pieces of infor- 



mation in the order in which they were recorded, in 
such a manner that they looks as if they were con- 
tinuous as in a single tape, the user familiar with 
audio tape or video tape can use an information 

5 medium with the data structure of the present 

invention without a sense of incongruity. 
3. The time map information (or time search table) 
is provided in the A_VOBI (or AOBI), management 
information about the audio information, which ena- 

10 bles a cell in the user-defined PGC to specify the 
playback range arbitrarily using the time map infor- 
mation. As a result, any area in the video informa- 
tion, still picture information, and audio information 
can be reproduced in any sequence. 

15 

Claims 

1. A data structure having an information area capa- 
ble of recording one or more different types of infor- 

20 mation including video information, still picture 
information, text information, stream information, 
and audio information which can be managed in a 
logical unit called a program chain, and a manage- 
ment information area capable of recording man- 
25 agement information with respect to recorded 
contents of the information area, 
characterized in that the management information 
In said management information area is configured 
to include information of the program chain that can 
30 manage collectively at least a sequence for repro- 
ducing contents of the audio information. 

2. The data structure according to claim 1 , 
characterized in that said program chain informa- 

35 tion includes management information called origi- 
nal program chain information that performs 
common management of all recorded contents of 
said different types of information. 

40 3. The data structure according to claim 1 or 2, 

characterized in that said program chain informa- 
tion Includes management information called origi- 
nal program chain information that indicates a 
sequence for reproducing all recorded contents of 
45 said different types of infonmation. 

4. The data structure according to any one of claim 1 
to claim 3, 

characterized in that said program chain informa- 
50 tion includes management information called user- 
defined program chain information that indicates a 
newly defined playback sequence among the 
sequences for reproducing recorded contents of 
said different types of information after information 
55 has been recorded or after the contents of the 
recorded information have been changed. 

5. The data structure according to any one of claim 1 
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to claim 4, 

characterized in that the management infomnation 
in said management information area includes pro- 
gram chain information that can manage collec- 
tively the sequence for reproducing the recorded 5 
contents of said different types of information. 

and that said program chain information 
includes Identification information for discrimi- 
nating said video information, still picture Infor- 10 
mation, text information, stream information, 
and audio information from one another. 

6. A data structure having an information area capa- 
ble of recording one or more different types of infor- is 
mation including video information, still picture 
information, text information, stream information, 
and audio information which can be managed in a 
logical unit called a program chain, and a manage- 
ment information area capable of recording man- 20 
agement information with respect to recorded 
contents of the information area, 

characterized in that the management information 
in said management information area includes pro- 
gram chain infomnation that can manage collec- 25 
tively at least a sequence for reproducing contents 
of the audio infomnation, 

that said program chain information includes 
time map information that corresponds at least 30 
to a playback time or playback position of the 
audio information and at least one of said video 
information, still picture information, text infor- 
mation, stream information, and audio informa- 
tion. 35 
and that said data structure is so constructed 
that the playback time or playback position of 
said audio information can be set arbitrarily via 
said time map information according to user- 
defined program chain information that indi- 4o 
cates a user-defined playback sequence 
among the sequences for reproducing said 
audio information. 

7. A data structure having an information area capa- 45 
bte of recording one or more different types of infor- 
mation including video information, still picture 
information, text information, stream information, 
and audio information which can be managed in a 
logical unit called a program chain, and a manage- so 
ment information area capable of recording man- 
agement information with respect to recorded 
contents of the infonnation area. 

characterized in that said data structure is so con- 
structed that the management information in said 55 
management information area includes at least pro- 
gram chain information that can manage collec- 
tively a sequence for reproducing contents of the 



audio information, 

and that said program chain information 
includes identification infomnation for discrimi- 
nating at least one of said video information, 
still picture information, text information, 
stream information, and audio information from 
one another. 

8. The data structure according to claim 7, 
characterized in that recorded contents of said 
information area include an audio cell as a unit in 
reproducing said audio information, 

and that said audio cell includes a silent cell 
corresponding to silent data of a specific 
period. 

9. The data structure according to claim 8, 
characterized in that said program chain informa- 
tion includes cell information, said cell information 
including entry point information that indicates a 
playback position of a cell, and said data structure 
is so constructed that a sounding time of the audio 
cell including said silent cell can be specified by 
said entry point information. 

10. The data structure according to any one of claim 7 
to claim 9, 

characterized in that a composite cell is defined as 
a unit in reproducing a combination of said video 
information and said audio information or a combi- 
nation of said still picture information and said audio 
information, 

that said identification information discrimi- 
nates said composite cell, 
and that said data structure is so constructed 
that, in reproducing said composite cell, said 
video information and said audio information or 
said still picture information and said audio 
information can be reproduced simultaneously. 

11. An infomnation medium on which one or more types 
of information which is related to at least one of 
video information, still picture information, text infor- 
mation, stream information, and audio information 
can be recorded with the data structure according 
to any one of claim 1 to claim 10. 

12. In an information medium having an audio informa- 
tion recording area for recording audio information 
and a management area for recording manage- 
ment information with respect to the recording area, 
characterized in that said infonnation medium is 
constructed so as to be able to record not only said 
audio information but also other information, 



16 



31 



EP 1 096 489 A1 



32 



that said management area is constructed so 
as to be able to further record nnanagement 
information with respect to infonnatton other 
than said audio information, 
and that related information about all among 5 
pieces of audio information in reproducing the 
recorded information is stored in said manage- 
ment area. 

13. In an information medium having an audio infonna- io 
tion recording area for recording audio information 
and a management area for recording manage- 
ment information with respect to the recording area, 
characterized in that said information medium is 
constructed so as to be able to record not only said is 
audio information but also other information, 

that said management area is constructed so 
as to be able to further record management 
information with respect to infonmation other 20 
than said audio information, 
and that related information about the audio 
information and information other than the 
audio information during reproducing is stored 
in said management area. 25 

14. An audio information recording method using an 
information medium having an information area for 
recording at least one of video information, still pic- 
ture information, text information, stream infomna- 30 
tion, and audio information, and a management 
area for recording management information with 
respect to said information area, said method char- 
acterized by comprising: 

35 

a first step of recording audio information onto 
said information medium; and 
a second step of writing additionally manage- 
ment information onto said information 
medium, or changing the management infor- 40 
mation, 

wherein said second step includes a step of 
additionally writing at least playback sequence 
information with respect to audio information in 
reproducing the audio information recorded at 45 
said first step into said management area, or 
changing and recording the playback sequence 
information in said management area. 

15. The method according to claim 14 so 
characterized in that said playback sequence infor- 
mation includes at least one of said video infomna- 
tion, still picture information, text information, and 
stream information. 

55 

16. A data structure having an information area capa- 
ble of recording at least audio information and a 
management information area capable of recording 



management information with respect to recorded 
contents of the information area, 
characterized in that the management information 
in said management information area includes pro- 
gram chain infonnation that can manage a 
sequence for reproducing at least contents of the 
audio information, said program chain information 
Includes cell information, and said cell information 
Includes entry point information that indicates play- 
back time information or playback position informa- 
tion in a cell, 

and that said entry point information makes it 
possible to set a specified position or a speci- 
fied time of an index in the audio information. 

17. An information medium having an information area 
capable of recording at least audio information and 
a management information area capable of record- 
ing management information with respect to 
recorded contents of the Information area, 
characterized in that the management information 
in said management information area includes pro- 
gram chain information that can manage a 
sequence for reproducing at least contents of the 
audio information, said program chain information 
Includes cell information, and said cell information 
includes entry point information that indicates play- 
back time information or playback position informa- 
tion in a cell, 

and that information can be recorded using a 
data structure that makes it possible to set a 
specified position or a specified time of an 
Index In the audio information according to said 
entry point information. 

18. A data structure having an information area capa- 
ble of recording at least audio infonnation and a 
management information area capable of recording 
management information with respect to recorded 
contents of the information area, 
characterized in that the management information 
in said management information area includes pro- 
gram chain information that can manage a 
sequence for reproducing at least contents of the 
audio information, said program chain information 
includes cell information, and said cell information 
includes entry point information that indicates play- 
back time information or playback position informa- 
tion In a cell, 

and that said entry point information makes it 
possible to perform a playback of said audio 
information and a display of a still picture simul- 
taneously, 

19. An information medium having an information area 
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capable of recording at least audio information and 
a management information area capable of record- 
ing management information with respect to 
recorded contents of the Information area, 
characterized In that the management information 5 
in said management information area includes pro- 
gram chain information that can manage a 
sequence for reproducing at least contents of the 
audio information, said program chain information 
includes cell information, and said cell information 10 
includes entry point information that indicates play- 
back time information or playback position informa- 
tion in a cell, 

and that information can be recorded using a 15 
data structure that enables a playback of said 
audio information and a display of a still picture 
to be performed simultaneously according to 
said entry point information. 

20 

20. A data structure having an information area capa- 
ble of recording at least audio information and still 
picture information and a management information 
area capable of recording management information 
with respect to recorded contents of the information 25 
area, 

characterized in that the management information 
in said management information area includes pro- 
gram chain information that can manage a 
sequence for reproducing at least contents of the 30 
audio information and the still picture information, 
and said program chain information includes cell 
information, 

and that said cell information is so configured 35 
that simultaneous display setting information 
that effects setting to display said audio infor- 
mation and said still picture information simul- 
taneously can be set in the cell information. 

40 

21. The data structure according to claim 20, 
characterized in that said cell information includes 
entry point information that indicates playback time 
information or playback position information In a cell 
and said entry point information makes it possible 45 
to set a specified position or a specified time of an 
index in the audio information. 

22. An information medium on which at least audio 
information and still picture information can be so 
recorded using the data structure according to 
claim 20 or 21. 
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